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5 RELATED APPLICATIONS 

The present application is a continuation-in-part of U.S. Patent Application Serial 
No, 09/344,688 filed on June 25, 1999 which claimed priority to U.S. Provisional 
Patent Application Serial No. 60/108,777 filed on November 17, 1998. 

BACKGROUND OF THE INVENTION 

10 Field of the Invention 

[0001] This invention relates to the field of delivery of multunedia content over 
a variety of networks. More specifically, it pertains to multimedia servers which 
service many clients simultaneously for the delivery of multimedia content which 
is used and played back at each client. It addresses methods for determining 

15 optimal delivery rates to each client and methods for determining whether new 
clients may be accepted without diminishing the quality of service to existing 
clients. 



Status of the Prior Art 

[0002] In the history of multimedia program delivery, some in the industry have 
20 long advocated the use of large client-side buffers and faster-than-real-time content 
delivery over a network as offering the best of all worlds: a jitter-free viewing 
experience and a cost-effective utilization of the network resources at hand. Few 
systems, however, go very far in addressing how to schedule clients or a method 
for accepting new clients. Real-time systems, often known as streaming systems, 
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can schedule new clients in a very simple manner -- if sufficient bandwidth 
remains for the added real-time stream, then the client may be accepted. 
However, such systems do not maximize the number of simultaneous clients. On 
the other hand, faster than real-time delivery, sometimes known as store-and- 
5 forward systems, opens up the possibility for more flexible scheduling procedures 
to control and optimize the number of simultaneous clients while ensuring a high 
level of quality of service. 

[0003] The methods for such call acceptance and flow modulation that have been 
proposed in the prior art have been largely ad-hoc and also incomplete. These 

10 have been ad-hoc in the sense that there has been no guiding rationale for their 
selection from among many possible and potentially superior alternatives. The 
methods have also been incomplete insofar as they did not address the question of 
whether any given incoming request for service should be accepted or denied. 
Video-on-demand systems, or more generally, any system in which a multimedia 

15 server is designed to serve multiple clients over a network to deliver bounded 
content, can benefit from the use of such flow modulation techniques and call 
acceptance procedures. 

Optimal Content Flow Modulation 

[0004] One time-honored way of designing methods of the class required here is 
20 to re-cast the problem to be solved as an optimization problem, in which one seeks 
to maximize a designated value function moment-by-moment, subject to a set of 
real-world operational constraints which will typically vary over time. 
Accordingly, given a set of clients and associated sessions, an optimal delivery 
procedure continuously establishes content flow rates from the content server to 
25 each of its clients so as to maximize aggregate value according to the governing 
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value function. 



[0005] This approach holds several advantages: 1) optimization problems are 
well understood, and are tractable by a large and diverse collection of 
computational methods; 2) if it exists, a global solution that is obtained is arguably 
5 optimal by construction, and thus superior or equal to all other. 

[0006] The present invention teaches the method of optimizing two particular 
value functions; 

1) total data delivered (maximize throughput). 

2) total delivery charges (maximize charges). 



10 [0007] The first value function does not distinguish one customer from another 
and will deliver as much data as possible from server to clients irrespective of the 
characteristics of the latter. The second value function favors the service of high 
paying customers. It can easily be seen that the first function is a special case of 
the second one whereby all clients are charged equally. 



15 [0008] As will be seen in this disclosure, optimizing for these functions and 

identifying the necessary constraints requires a new and unique perspective that is 
specifically designed for the multimedia environment. Moreover, the disclosed 
methods are specifically designed to account for and accommodate real-world 
scenarios of today's networks. Consequently many variations of the method are 

20 presented to accommodate various scenarios. 
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SUMMARY OF THE INVENTION 
Call/Connection Acceptance Contro l (CAC) 

[0009] A CAC procedure is responsible for deciding whether a candidate for 
service can be accommodated without jeopardizing sessions already in progress at 
5 the present time or at some time in the future; failing that it must decide whether a 
service request should be queued for a time or rejected. 

Flow Modulation 

[0010] Flow modulation methods are those portions of the system which manage 
the communication and data flow between the server and the clients. Collectively, 
10 these methods provide the multimedia data to the client and provide the server with 
the information about the state of the transmission, playback, user status and 
network status. These parameters are further used by the present invention in the 
CAC procedures. In fact, as will be shown, the proposed CAC procedures are 
tightly integrated with the flow modulation methods. 

15 Adaptation to Variations in Network Capacitv 

[0011] Operational constraints may change over time. For instance, one might 
elect to vary the total bandwidth available for multimedia content delivery 
according to the time of day. Alternatively, exogenous data flows on the network 
may cause unexpected disturbances by usurping available bandwidth and impeding 

20 the delivery of data along established session channels. The content delivery 

strategy of the present invention includes the ability to adapt to scheduled as well 
as unexpected disturbances so as to minimize unwanted disruptions of services. 



Burst Transmissions Provide the Qpportunitv to Adapt 

[0012] The present invention, due to it's faster-than-realtime transmissions (also 
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know as burst transmissions), which are realized by use of high-bandwidth 
networks and large client cache or intermediate storage, provides an opportunity to 
adapt to changing network conditions. In contrast real-time (streaming) systems 
are essentially designed for worst-case scenarios: each client must be assumed to 
5 constantly use the complete real-time playback bandwidth. Such a system is 

unable to adapt to any derivation from this scenario. For example, take the simple 
case where the total server bandwidth is 100% utilized by all clients playing back 
the streaming video. Should any network condition change, such as a temporary 
decrease in available bandwidth over the network, then one or more clients' 
10 playback is interrupted, and the system can not recover from such a condition until 
the bandwidth is regained. Even worse if a single client presses pause either that 
unused bandwidth must remain reserved and no more clients can be accepted, or 
that paused client is pushed out in order to service the new client. In essence little 
or no CAC procedure may be implemented. 

15 [0013] In contrast the present invention burst transmits portions of a program 
and immediately 'gets ahead of itself, thus allowing headroom for a myriad of 
methods to intelligently handle new clients, client interactivity and possible 
network fluctuations. 

[0014] Methods are taught for optimally determining the flow rate to each client. 
20 Methods are also taught for accepting or rejecting new clients; these call- 
acceptance methods are tightly coupled with said flow rate modulation methods. A 
series of constraint expressions are presented which govern the methods for 
determining the flow rates and acceptance of new clients. Linear programming 
techniques are used to optimally solve these expressions. Various embodiments 
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are presented including scenarios for multiple-rate tariffs, and time-of-day 
bandwidth variations, 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0015] These as well as other features of the present invention will become more 
5 apparent upon reference to the drawings wherein: 

Figure 1 depicts the flow of control and/or data between the different 
stations of a content delivery session; 

Figure 2 illustrates the Entity Data Model; 

Figure 3 geometrically illustrates the linear programming problem 
10 statement; 

Figure 4a geometrically illustrates an expansion of the flow optimization 
problem statement; 

Figure 4b geometrically illustrates the method for rapid determination of 

flow rates to maximize flow; 
15 Figure 5 illustrates a method for implementing flow modulation to 

maximize flow; 

Figure 6 illustrates a method for implementing flow modulation for 
maximized charges; 

Figure 7 illustrates typical content flow; 
20 Figure 8 illustrates typical server swing capacity; 

Figure 9 illustrates a method for call-acceptance and control (CAC); 
Figure 10 illustrates planned constraints on maximum flow; 
Figure 1 1 illustrates a method for call-acceptance and control (CAC) with 
scheduled flow changes; 
25 Figure 12 illustrates stratification of services; 
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Figure 13 illustrates a method for call-acceptance and control (CAC) for 
maximal charge; 

Figure 14 is a system block diagram for a system implementing the 
present optimization of client bandwidth; 
5 Figure 15 is a flowchart showing an algebraic method for calculating the 

optimization of client bandwidth; 

Figure 16 is a flowchart showing an algebraic method for calculating the 
optimization of client costs; and 

Figure 17 illustrates optimized viewing of a live event. 

10 DETAILED DESCRIPTION OF THE INVENTION 

Data & Control Flows (Figure I) 

[0016] Figure 1 depicts the flow of control and/or data between the different 
stations of a content delivery session. As shown a client attempts a connection 100 
and manifests itself to the Content Selection subsystem by means of a low 

15 bandwidth control channel (not shown). Next the client is authenticated and a 

selection is made 110, typically with the aid of browser software. If the client is 
not authenticated, it is dismissed from the system 120. If the client has been 
authenticated and a program selected for viewing then the rate of service is set at 
this point 130, perhaps according to the selection that was made, or some 

20 contractual stipulation. The client is now placed on the service queue of the CAC 
subsystem 140. A client that is made to wait too long will eventually balk 150. 
Assuming this does not occur, the CAC subsystem 140 will eventually allocate a 
channel to the client and open a session 160. Control now devolves upon the 
Content Flow Modulator (not shown) which starts the flow of content from server 

25 to client 170. Subsequent capacity changes, whether predictable or not, may force 
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an abrupt termination of a session in progress 180. Otherwise the session runs to 
completion 190. 

Entity Data Model (Figure 2. listing, table) 

[0017] The entities entering into our discussion are depicted in Figure 2. Client 
5 200 maintains certain data associated with this entity; as shown but not labeled, 
which includes without limitation, status, id and costOfService. The other entities 
also each include unlabeled but depicted data. The diagram further depicts the 
relationship between each entity. As shown, client 200 is assigned a session 240. 
Client 200 employs a channel 210. Client 200 selects contentSelection 230. 
10 Session 240 delivers content through channel 210. Server 220 modulates channel 
210. Server 200 contains contentSelection 210. Server 220 accepts, defers or 
denies client 200 and contentSelection 230 is associated with session 240. 

[0018] Furthermore Figure 2 depicts the various one-to-many relationships. 
Each client 200 employs one channel 210. Client 200 may or may not receive one 

15 of channel 210, as depicted by the 0/1 notation. Similarly, client 200 may or may 
not receive a session 240. However, whenever client 200 does receive a session 
240, it will always receive a channel 210 since channel 210 and session 240 are 
allocated as a pair. One or more (N) of client 200 may select one of 
contentSelection 230. And server 220 contains one or more (N) of 

20 contentSelection 230. Each one of contentSelection 230 is associated with 0-N of 
session 240. Each session 240 delivers content through one of channel 210, And 
server 220 modulates one or more (N) of channel 210. 

[0019] A more detailed list of each entity of Fgure 2, and each one's associated 
description, data elements and function calls is listed below. This listing closely 
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resembles that of object-oriented programming. As such, 'methods' represent the 
ability to obtain or modify data, while 'attributes' represent data which is directly 
associated with that particular entity. The listing also includes information relating 
to one embodiment wherein software programming specifics are disclosed, such as 
a variable type (double, int and so forth) and more. The present invention is not 
limited to such an embodiment and other implementations are possible without 
deviating from the scope and intent of the present invention. The listing, however 
detailed, is merely illustrative of the data and functions which are used in the 
equations and methods described herein. 

[0020] Consequently, data and functions from this listing, associated with the 
various entities, will be used in forthcoming equations, flowcharts and methods. 
The reader is directed to this listing as reference when reading such equations and 
examining such drawings. 

— start of entity data model detailed listing — 
Model: Untitled 1 (public) 

Contains: 

client, session, channel, server, contentSelection. 
Component: client (public Class/Interface) 

Comment: 

A client entity stands for a client presently requesting or receiving service. 
Methods: 

public static lookup (id: in int) : client 

public Getid () : const int& 

public Setid (val : in int&) 

public GetCostOfService 0 : const double& 
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public SetCostOfService (val : in double&) 
Attributes: 

private status: client <int> 

Specifies whether or not a client has been allocated a channel and session. 

5 private id: int 

Integer-valued identifier that is unique to the client (primary key). Can be 
obtained from a monotonically increasing counter. 

private costOfService: double 

Dollar charge per Mbyte. This value is the same for all customers under flow 
10 optimization. Under cost/charge optimization may be an integer value 

reflective of the rank; the higher the rank the higher the charge. 

Has: 

public selected: contentSelection 
public assigned a: session 
15 public employs: channel 

Component: session (public Class/Interface) 

Comment: 

A session entity holds various state information about the service being 
received by an associated customer. 

20 public GetCurrentPosition 0 : const double& 

public SetCurrentPosition (val : in double&) 

public GetPayloadToGo () : const double& 

public SetPayloadToGo (val : in double&) 

public GetStatus 0 • const int& 
25 public SetStatus (val : in int&) 

public GetMinimumFlowRate () : const double& 
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public SetMinimumFlowRate (val : in double&) 
public GetFlowRateRange () : const double& 
public SetFlowRateRange (val : in double&) 
public GetMaxFlowRate 0 • const doubIe& 
public SetMaxFlowRate (val : in double&) 



Attributes: 

private playTimeToGo: double 

Indicates the minutes remaining in the viewing experience. Initialized to 
contentSelectiont.playTime (see below). 

private currentPosition: double 

Pointer into media content from which content is being delivered, 
private payloadToGo: double 

The amount of media content (in Mbytes) as yet undelivered by the server. Does 
not include any content presently stored in the client-side buffer. 

private status: int 

Indicates whether sesion is active or paused, 
private minimumFlowRate: double 

This is the minimum flow from server to client required to ensure uninterrupted 
service over the remaining playTime, Has a value of zero if playloadToGo is 
zero. Given by (payloadToGo * 8)/(playTimeToGo *60) 

private flowRateRange: double 

Specifies the effective range over which the channel content flow serving a 
session is constained without consideration for interactions with other flows. 
Equals maxFlowRate - minimumFlowRate 

private maxFlowRate: double 

Effective maximum bound on flow as expressed in formula (8) which must be 
re-evaluated periodically. 
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Has: 

public delivers content through: channel 
Component: channel (public Class/Interface) 

Comment: 

5 A channel represents the network resources from server to client associated 

with an ongoing session, encompassing the client-side buffer if any, and its 
level. 

public GetBufferLevel 0 : const double& 
public SetBufferLevel (val : in double&) 
10 public GetFlowRate () : const double& 

public SetFlowRate (val : in double&) 
public GetMaxFlowRate () : const double& 
public SetMaxFlowRate (val : m double&) 



Attributes: 

15 private bufferSize: double 

Capacity of the client-side buffer (or equivalent) 

private bufferLevel: double 

Current buffer level in MBytes of stored content. 

private flowRate: double 

20 Flow rate through channel specified by the relevant optimizing flow 

modulator. 

private maxFlowRate: double 

This value represents the maximum possible flow rate from the server to an 
individual client over its "channel". This value reflects restrictions on flow that 
25 pertain to an individual client. It may be determined by factors such as the 

bandwidth of client's link to the network, or a limit imposed administratively to 
ensure balanced network utilization. 
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Component: server (public Class/Interface) 

Comment: 

Entity representing the media server and its CAC and flow modulation 
activities. 

5 public GetFlowRate () : const double& 

public SetFlowRate (val : in double&) 
public GetMaxMinFlowRateQ 0 : const double& 
public SetMaxMinFlowRateQ (val : in double&) 

Attributes: 

private maxFlowRate: double 

Maximum possible content flow that is allocated to the server by the network, 
private flowRate: double 

Aggregate content flow rate, summed over all sessions and their associated 
channels. 

private cac flowSafetyMargin: double 

Tunable safety margin used by the CAC algorithm to protect sessions-in- 
progress from being affected by changes in available network bandwidth. 

private maxMinFlowRateO: double 

Applies when N rate tariffs exist. This array holds the maximum floor level 
for each category of service. The value for the costliest category N is stored 
in maxMinFlowRate[N-l], and for the least costliest in maxMinFlowRate[0] . 
It is the relative magnitude of these ascending values that matters, not their 
absolute value. Thus the actual maximum floor flow rate for category k is 
given by server. maxFlowRate * (server. maxMinFlowRate[k-l] 
/server. maxMinFlowRate[N-l]). Similarly, the maximum floor flow rate for 
category N is server.maxFlowRate. 

Has: 

public contains: contentSelection 
public modulates: channel 
30 Component: contentSelection (public Class/Interface) 
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Comment: 

Entity represents a video/sound clip or other bounded unit of content. A 
continuous data feed does not qualify. 

Attributes: 

private averagePIayRate: double 

The average rate at which media content is consumed by the client, as 
computed by dividing the (payload 8) by the (playTime * 60) 

private playTime: double 

Duration of play of the media content in minutes. 

private payLoad: double 

total size of the content in Mbytes. 

Has: 

public is associated with: session 

— end of entity data model detailed listing — 
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The following table summarizes the highlights of the previous detailed 
description of each entity in Figure 2. 

TABLE 1 
Entity Description 

client 200 Each client is denoted by an associated unique integer 

index The set of active clients is denoted by 

^ActiveClients* 

The set of deferred clients is denoted by 

^QdClients. 

Incoming clients are expected to select the content they 
wish to view prior to being queued for dispatch by the 
CAC sub-system, which requires knowledge of the 
client's bandwidth requirements, duration of play, and 
cost of service, all of which may vary according to the 
selection. 

server 220 Servers sit astride a network and can deliver media 

content through the network to their clients up to a 
designated maximum flow rate. The server is 
responsible for accepting or rejecting clients, launching 
sessions and associated channels for the former, and 
modulating content flows over all channels in an optimal 
manner, 

channel 210 A channel represents the data path between the server 

and the client. The channel buffer is typically located 
near or within the clients viewing station. The flow of 
content through the channel is set by die flow modulator 
sub-system. 
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contentSelection 230 A server will typically act as a repository for media 

content, which it can deliver to clients upon demand. For 

our purposes, media content is characterized by its 

payload and the play duration, which together imply the 

averagePlayRate = (payload*8)/(playTime *60). The 

averagePlayRate is none other than the streaming rate 

imposed by real-time just-in-time streaming algorithms, 
session 240 Every session represents an instance of media content 

delivery to an associated client over a designated 

channel. The playTimeToGo indicates the time 

remaining before the content is fully played out to the 

client. The payloadToGo is the amount of content data 

as yet undelivered to the channel. A session terminates 

when this value reaches zero, at which time 

playTimeToGo may still be large, according to the 

capacity, the level of the channel buffer, and the media 

play rate. 

Constraints On Content Flow 

[0021] Before referring to more Figures, it is imperative to establish some 
formulas and problem statements which are used in the methods which follow. 

[0022] The flow of content between entities is subject to the following constraints 
at all times. Buffer levels are always expressed in Mbytes and data rates in 
Mbits/sec. 
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(1) S i e sactivecuents (client.lookup(i)xhannel.flowRate) < = server. maxFlowRate 
The sum of all channel flows cannot exceed the imposed maximum throughput 
capacity of the server. 

(2) client,lookup(i). channel. flowRate < = client. lookup(i).channel.maxFlowRate 

5 for all i e SactiveCUents 

The data path from server to client is subject to its own constriction, 

(3) client.Iookup(i). channel. flowRate < =(client.lookup(i).channeLbufferSize - 
client.lookup(i). channel. bufferLevel )* 8/60 + 

client.lookup(i).session.mediaContent.averagePlayRate, for all i € Sactivecuents, 
The channel buffer is never allowed to overflow. 

(4) client.lookup(i). channel. flowRate <= client. lookup(i).session.payloadToGo * 
8/60 

for all 1 e Sa^^iiyeciignts, 

15 Content that does not exist cannot be delivered. (Constraint 1 will ordinarily 
prevail except at the very end of a session.) 



[0023] The constraints listed above are straightforward applications of common 
sense in relation to the flow of data through constricted channels, out of finite data 
sources, and into and out of bounded buffers. By contrast, the following 

20 constraint, which imposes a minimum channel flow rate instead of a maximum, is 
less obvious. The minimum value, termed the minFlowRate is set to the flow rate 
which, if sustained over the balance of the play time to go (playTimeToGo), 
ensures that all required content will be available when needed — and no sooner — 
until all content is played out. This floor value can be calculated for i e Sgj^iy^cuents 

25 by the formula: 
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(5) client.lookup(i). session minFlowRate =(client.lookup(i).session.payloadToGo * 
8)/ (client.lookup(i),session.playTiineToGo * 60) 

Accordingly, the flow rate on the right-hand-side is termed the just-in-time (JIT) 
flow rate (f ^^). 

5 Thus: 

(6) clientJookup(i). channel. flowRate > = client. lookup(i). session. minFlowRate 

for all i € SactiveCUents 

[0024] The variable constraint bounds (i.e. the values to the right of the inequality 
symbol) of equations 1-4 and 6 are re-evaluated on a periodic basis (e.g. once 

10 per second) prior to the execution of the CAC procedure and optimizer. In 

particular, the minFlowRate value starts out at the beginning of a session equal to 
the streaming rate. By construction the minFlowRate rate never exceeds this 
initial value so long as constraint 6 is honored. In fact, constraint 5 implies that 
the minflowRate value must be a diminishing function of time that may hold its 

15 value for a time but never rises. As seen from equation 6, the actual data rate of 
the chaimel, flowRate, is always greater than or equal to the minFlowRate, By 
design, and virtue of the fact the present invention uses faster-than-realtime 
transmissions, the system quickly gets ahead of itself and ensures that after initial 
conditions, the minFlowRate is always equal to or less than the real-time rate and 

20 that it continues to decrease. As we shall see, the CAC procedure exploits this 
monotonic characteristic of the minimum flow rate over time. 

[0025] Constraints 2, 3 and 4 are of like kind, each specifying an upper bound on 
individual channel flows. Whereas the bound for constraint 2 is typically a 
constant, the bounds on 3 and 4 will vary over time. Nevertheless, only one of the 
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three bounds is effective at any given time, namely the one with the smallest bound 
value, given by: 

(7) client Jookup(i).session.maxFlowRate = minimum of 

1 ) client . lookup® . channel . maxFlo wRate , 

5 2) (client.lookup(i)xhanneLbufferSize - 

client.lookup(i).channeLbufferLevel)* 

8/60 + client.lookup(i).session,mediaContent.averagePlayRate, 

3) client.lookup(i).session.payloadToGo * 8/60 

Consequently, fonnulas 2, 3, and 4 can be consolidated into a single constraint, 
10 the bound for which is computed at every scan to be the smallest bound of 
associated constraints 2, 3 and 4. 

(8) client. lookup(i). channel, flowRate < = client.lookup(i).session.maxFlowRate, 

whereby for all i € Sa^.tweciients , maxflowRate is given by equation (7). 

At any one time, individual channel flows are constrained over a range, as 
15 follows: 

(9) client. lookup(i). session. flowRateRange = 

client, loolcup(i) . session.maxFlowRate - client.lookup(i) , session.minimumFlowRate 
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Value Functions 

[0026] The value functions introduced previously can be expressed mathematically 
as linear functions of channel flows, as follows: 

Optimizing Throughput (Maximal Flow^ 
5 (10) value = S i e sactiveciients cUeut . lookup(i) . channel , flo wRate) 
Optimizing Charges (Maximal C harges) 
(11) value = S ie Sactiveciients (client.lookup(i)xhannel.flowRate * 
client . lookup(i) . costOfService) 

Optimization Problem Statement (Figure 3) 
10 [0027] The optimization problem, which in one embodiment is strictly throughput 
and in another case is charge, can be stated simply as follows: 

Find values for 

client.lookup(i). channel. flowRate for all i e Sactiveciients 

constrained by inequalities 1 through 5, such that the value obtained by 
15 evaluating expression 10 or 11 assumes a maximum. 

[0028] Both of these problem formulations are examples of Linear Progranraxing 
for which a number of well-known and generally effective computational solutions 
exist. In linear programming one seeks to optimize a linear cost function of 
variable x 



20 



(12) c*x = Cj^Xj + ....+ c/x^ 

subject to a set of linear inequality constraints 
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(13) A*x < = b 

where x"^ = (Xi,,..,xJ, c ^ (Ci,...,cJ are the state variable & cost vectors, A is an 
n-by-m matrix, b^ = (bi,...bj is the constraint vector, and the operator stands 
for matrix or scalar muhiplication. 

5 [0029] Figure 3 is introduced as illustrative of the problem statement and the 
general methods of the prior art, and is not incorporated as an element of the 
invention. 

[0030] The linear programming problem as well as its solution can best be 
understood with the aid of geometry. Figure 3, depicting a 2-dimensional 

10 Cartesian problem space, inequality constraints (13) define a convex hull H 310 
over which a search for an optimum value of x = (xi,X2) is permitted to range. 
The cost vector c 350 defines an infinite family of equal cost Imes (hyper-planes) 
which lie orthogonal to c. Three examples of such lines are shown in Li 360, L2 
365, and L3 370. , each of progressively higher value. The supreme value of the 

15 cost function is obtained by sliding along c 350 till one can go no further, in this 

instance toward vertex V4 340 of hull H 310. Many well-known methods (e.g. the 
Simplex Method) work roughly in this fashion, exploiting the fact that at least one 
opthnum point must be at a vertex. In particular, the Simplex method algorithm 
begins by finding a vertex (e.g. V2 320), and then moves along a sequence of 

20 vertices (e.g. V3 330, V4 340) improving itself each time until no further 
improvement is possible & die summit is reached. 

[0031] Let us suppose instead that V3 330 were placed along L3 370 along with V4 
340. According to prior art methods, V3 330 and V4 340 are the two possible 
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solutions, but the equally valuable points in between them are not. As we shall 
soon see, the problem of throughput optimization (6) falls in this category. 

[0032] While vertex Vj 300 does not factor into this description, it is depicted in 
Figure 3 for completeness. 

5 Flow Modulation 

Methods for Maximal Flow 

The following sections detail two embodiments to optimize total data flow. 

Overview (Figure 4-a^ 

[0033] Figure 4-a depicts a scenario involvmg two flows. The convex hull is in 
10 this instance bounded by line segments LI, L2, L3, L4 and L5. L6 is a boundary 
used in a different embodiment, however the present embodiment uses L5 and not 
L6. Flow f2can range over the interval separating line segments LI from L3, 
namely f2^™ and f2'^^'^; the range is depicted as f2'^^'^^. Flow fj can range over the 
interval between lines L2 and L4, namely fj^^^ and fj^^^, and depicted as fj^^GE 
15 The sum of flows fj and f2 is constrained to lie inside of line segment L5 which, by 
construction, is always orthogonal to the cost vector Cf . Cost vector is also 
illustrated but used in a distinct embodiment. In the present embodiment only Cf 
is used. In the illustrated example of the present embodiment, the constraint on 
total flow is set to 5, and is therefore low enough to cause L5 to intersect L3 and 
20 L4. This would not have been true had the value chosen had been 10 instead of 5. 
With L5 safely out of contention, the convex hull would instead be a simple 
rectangle bounded by LI through L4, thereby permitting both flows to assume 
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their respective maxima without interference. In practice operational constraints 
exist intrinsically or are imposed from the outside so as to ensure cost effective 
sharing of potentially costly network resources. 

[0034] Supposing Figure 4 to be correct, the well-known methods would select 
5 vertex V3.5, which lies at the intersection of L3 and L5, or ¥4.5, which lies at the 
intersection of L4 and L5. These solutions, though optimal, are undesirable for 
the present invention as they fail to spread available bandwidth over all channels as 
fairly as would a centrally located interior point of L5. For this reason, two 
alternative optimization methods are taught, which are adapted to the particular 
10 needs of this problem and ensure a fairer allocation of constrained bandwidth 
among all channels. 

Iterative Procedure (Figure 5) 
[0035] In order to optimize use of all available bandwidth, the following general 
method is used, with the details illustrated in Figure 5. This method is a solution 
15 for the problem illustrated in Figure 4-a, which geometrically illustrates the 

optimization problem in the limited case of two flows, fl and f2. The following 
description expands the problem to an arbitrary number of clients (and therefore 
flows) and presents a method for solving this optimization problem. 

[0036] Referring to Figure 5, in step 500, values are calculated for the session 
20 maxFlowRate and session.minFlowRate for each client as per the minimum and 
maximum constraint bound expressions in equations 6 and 8, respectively. This 
step correlates to the determination of fjmin, f^max, f2min and f2max from Figure 
4-a. 
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[0037] The difference between these two yields the session.flowRateRange of 
each client. Thus: 

session.flowRateRange = session maxFIowRate- session.minimumFlowRate 

[0038] In step 505, the active clients are sorted in an ascending fashion based 
5 upon their session JIowRateRange, As will be shown this critical step facilitates 
allocation of the remaining server bandwidth as evenly as possible among all active 
channels, thus maximizing the number of channels that benefit by use of the total 
server bandwidth. An arbitrary assignment of remaining bandwidth is likely to 
saturate the server before all channels have been assigned extra bandwidth, thereby 
10 favoring certain channels on an ad-hoc basis. This step correlates to keeping the 
solution in bounds of the space delinated by line segments L1-L5 of Figure 4-a. 

[0039] In step 510, each client's channel flow rate is set to the session 
mimimumFlowRate , 

[0040] By doing so, it is ensured that the minimum flow constraint is met for each 
15 session and that the minimum flow rate is a non-increasing function of time, which 
is critical to the proper functioning of the CAC procedure. This portion of the 
process also ensures that the solution, starting from the vertex in Figure 4-a as 
defined by the intersection of LI and L2, moves generally in the direction of 
vector Cf . All clients are also marked as unprocessed. 

20 [0041] In the next step, 520, server.flowRcae is set to the sum of each active 
client's session.flowRate. 
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[0042] Next, the following is iterated over all clients in sorted sequence (during 
any given iteration the selected client is given by its id) by performing steps 530 
through 570. In step 530 evaluating the following expressions test for possible 
server saturation: 

delta = (server.maxFlowRate - server. flowRate) / (qty of un-processed clients) 
range = client.lookup(/rf).session.maxFlowRate - 
client .lookup(wf) , session. flowRate 

[0043] If range is greater then delta, this implies that the server can be saturated 
in this iteration by allocating delta to all unprocessed clients (step 540). 

[0044] On the other hand, the 'no' path for step 530 implies that the server is not 
saturated and that the present client (given by id) will saturate first. Accordingly, 
in 550 the delta variable is set as follows: 

delta ~ range 

[0045] To again correlate this process back to the geometry of Figure 4-a, server 
saturation is indicated when the solution which is being sought in the direction of 
vector Cfgoes beyond line segment L5. 

[0046] Next, the flow rate is incremented for all unprocessed clients by delta, 
causing client id to saturate, 

[0047] In step 560 the server flow rate is adjusted accordingly: 

server, flowRate = server.flowRate + delta * (qty of unprocessed clients) 
In step 570 the client given by id, now saturated, is marked as processed. 
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Algebraic Procedure (Figures 4-b and 15) By Interpolation 
[0048] Referring to Figure 4-b, the iterative method described in the previous 
section begins its search for a maximum from vertex Vj^in along the direction 
shown by line Cj. In contrast, the present method follows the diagonal line 
5 segment L^jag of the rectangle bounded by lines LI through L4, starting at vertex 
and ending at point Vj^. 



[0049] Provided it exists, the intersection between L^iag and L5, indicated by Vf, is 
optimal on the same basis as any other point lying along the intersection of L5 
with the rectangle bounded by LI through L4, as previously discussed. 

10 [0050] Whenever L5 does not intersect this rectangle, the optimal solution is given 
by vertex V3-4 at which f 1 and f2 both assume their respective maxima. 



[0051] In the first instance, the coordinates for point Vf can be obtained by 
elementary vector geometry and algebraic manipulation, as follows: 

First, we define a number of abbreviations, 
15 f^^"^ represents client.lookup(k). session. minimum flow rate 

^^range j^gp^-^gg^^g client. lookup(k).session.flow rate range 

fg^f ^ represents server.maxflowrate 



We seek scale factor x such that the vector sum of 

(f™... f^'")+ X (f/^"^^... fjj^^^^) intersects an equi-cost hyperplace for capacity c. 
20 The point of intersection is obtained by solving equation: 

(fr ^ . . . +x(f/'"^^ + . , . ^fj"^^^) = c 
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Solving for x, we obtain: 

^ = [f sT - (f r" ^ - • ^ f r)] /(f r'' ^ . . . + 



where fg^^ - (f f^^" + . , . +f^""') represents the unused bandwidth beyond the minimum 
allocation for each session. For any given session, the optimal flow rate is given 
5 by: 

or 

^^^^min^^_range^ ifx>l 



[0052] This solution by interpolation is interesting by virtue of the great efficiency 
10 of the calculation, and the fact that no session saturates (x > = 1) unless all sessions 
saturate. In contrast, the previous method entails considerably more computational 
effort, and tends to saturate sessions with the lowest reserve capacity. 

[0053] A block diagram for this algorithm is depicted in Figure 15. Block 1500 
establishes the maxim and minima for each flow. For each flow the minimum is 
15 subtracted from the maximum to obtain the range. Available Bandwidth is 

calculated in block 1520, as the difference between the aggregate flow capacity 
and the sum of flow minima. Factor x is calculated next in block 1540, and tested 
against 1 in block 1650. Flow rates for each session are computed in block 1560 
if X is less than 1, or 1570 in the contrary case. 

20 A Method for Maximal Charge 

[0054] The following sections detail one embodiment to optimize the total 
monetary charges within the system. The second method is algebraic in nature, 
and thus very efficient. 
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Overview (Figure 4-a) 
[0055] Referring back to Figure 4-a, cost vector lies orthogonal to line L6, 
which intersects the convex hull at the vertex formed by the intersection of lines 
L4 and L5, namely V4.5. This cost vector, and the optimal point that it implies, 
5 favors flow fl over flow f2 . In this example, as the cost of service for fl equals 
2, thus exceeding the cost of service of 1 set for f2 . As the number of flows grow 
to exceed the number of distinct categories of service (and associated costs of 
service) the unique optimal solution, depicted in Figure 4 for the case where every 
flow has a distinct cost of service, no longer applies. Once again a plurality of 
10 flows within a service category vie for bandwidth which a method should endeavor 
to distribute evenly. This method is derived from the previous one, and optimizes 
one cost category after another, starting with the most costly and ending with the 
least costly, or when all available capacity is allocated. 

An Iterative Search Procedure (Figure 6) 
15 [0056] Let the service categories be denoted by k= 1...N, where k also denotes 
the cost of service. 

[0057] Let Ci . .Cn be the partition of Sactiveciients th^t places all clients with cost of 
service k in set C^. Partition sets can be ordered to form sequence SeqC = 

20 [0058] Figure 6 depicts the method for implementing the method to maximize the 
cost of service (service charge). 

[0059] This method is nearly identical to the iterative procedure used to maximize 
flow. The principle difference stems from the partitioning of clients according to 
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their category (cost) of service: clients charged most are allocated bandwidth 
preferentially. This is accomplished by adding another level of iteration around the 
method of Figure 5. The inner iteration (steps 650 through 680) functions exactly 
as before, with the difference that its actions are limited to the clients belonging to 
5 the given service category A: (i.e. C^). This difference also holds true of step 640 
which sorts category k clients according to their flow ranges prior to entry in the 
bandwidth-allocating inner loop. The outer loop proceeds down a sorted sequence 
of service categories SeqC (generated in step 630), starting with the category 
generating the greatest revenue to the service provider. Given a fairly static set of 
10 service categories, this sort need be performed only when the categories undergo 
change. Steps 670, 675 and 680 are identical to their counterparts in the method 
of Figure 5 (i.e. 570, 575 and 580). 

[0060] The net effect of this method is preferential allocation of bandwidth 
according to category of service, and equitable treatment of clients within the same 
15 category of service. 

An Iterative Algebraic Procedure (Figure \6) 
[0061] The algebraic method used to maximize bandwidth (Figures 4b and 15) can 
be viewed as a special case of cost optimization in which all costs are equal. By 
construction, all sessions belonging to a given category, starting with the most 
20 expensive category, and ending with the least, and updating available bandwidth 
after each step in sequence, we obtain an iterative algebraic method that scales 
much better than the preceding method. 

[0062] A block diagram for this algorithm is depicted in Figure 16. Block 1600 
establishes the maxima and minima for each flow. For each flow, the minimum is 
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subtracted from the maximum to obtain the range. In block 1610, every session 
flow is assigned the minimum allowed value, which value will apply by default 
should the iterative procedure run out of bandwidth before all categories can be 
considered. Block 1620 computes the initial value for available bandwidth, as the 
difference between the aggregate flow capacity and the sum of flow minima. 

[0063] Flow values are obtained for each cost category in order of decreasing cost 
within blocks 1640 through 1675. Factor x is calculated next in block 1540, and 
tested against 1 in block 1650. Flow rates for each sessions of the category under 
consideration are computed in block 1660 if x is less than 1, or 1670 in the 
contrary case. In the former case there is no more bandwidth to allocated to the 
sessions in the category under consideration. 

Call Acceptance Control (CAC) 

CAC for Ma ximal Flow Overview CFigures 7-R^ 
[0064] The CAC procedure applicable to this flow optimization relies on the 
essential step of accepting a new client if and only if ttie added load induced 
thereby does not compromise service to existing clients or the new one. This 
critical step could not be accomplished without the close integration with 
previously- described flow-modulation methods of Figures 5, 6, 15 and 16. 

[0065] According to the previous discussion, the minimum flow rate is the 
minimum sustained flow rate that guarantees that the associated viewer will not be 
subject to interruptions in service due to a shortfall of content from the media 
server. It follows that whenever data is being delivered at a rate in excess of the 
minimum flow rate, a downward adjustment toward the minimum level could be 
accommodated as needed to surrender bandwidth to any newcomer. 
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[0066] Figure 7 depicts content flow over a channel for the course of a typical 
session, and also how data is delivered under real-time streaming D. The amount 
of content delivered is the same in either case, but the manner of delivery differs 
considerably. A session is launched at time 0 as the network is lightly loaded, and 
5 the optimizer sets an accordingly high flow rate. Another client emerges at the 
end of interval 700, causing a downward adjustment to the flow rate over interval 
B, as available bandwidth is shared between two sessions. During both of these 
intervals the minimum flow rate 720 drops quickly, as data accumulates in the 
client's media buffers. At the end of interval B, a massive influx of clients 
10 necessitates that flow be dropped to the minimum flow rate, which now lies 

substantially below the streaming rate D and is held until all data is delivered at the 
end of interval C. Note that the minimum flow rate, shown as element 720, 
diminishes monotonically over time. 

[0067] The server swing capacity is defined as the difference between the 
15 maximum capacity of the server and the total minimum flow rates for all active 
clients. Therefore: 
(14) swingCapacity = 

server.maxFlowRate - S j e sactivecuents (client.lookup(i).session.minFlowRate) 

[0068] Given the monotonic decreasing nature of session minimum flow rates, 
20 server swing capacity can readily be seen to be a monotonic increasing function of 
time over the intervals separating client admissions, at which point it undergoes a 
drop as a new load is taken on. This all-important characteristic implies the 
following: 
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Any client admitted for service based on the present value of swing 
capacity is guaranteed to have sufficient bandwidth at its disposal over the entire 
future course of the session, 

[0069] Figure 8 depicts the server swing capacity 800 over the course of the 
5 sessions illustrated in Figure 7. Swing capacity rises quickly over intervals A & B 
as data is delivered at high flow rates over the network. It holds steady over 
interval C when all channels flow at their minimum rate then jumps at the end of C 
before resuming its monotonic rise once again. 

Procedure (Figure 9) 

10 [0070] In this procedure, which executes on a periodic basis, queued clients 
awaiting bandwidth are scanned in FIFO order. For each one, the required 
bandwidth is computed as per the client's prior content selection. If the available 
swing capacity (reduced by a safety margin) exceeds the amount required, then the 
client is activated and swing capacity is adjusted accordingly. Otherwise, two 

15 possible cases are considered: 1) under the FirstFit embodiment, the procedure 
continues scanning clients to the end of the queue, activating clients whose 
requirements can be met; 2) under the FIFO embodiment, the procedure ends with 
the first candidate client whose requirements cannot be met. 

[0071] In step 900, available server swing capacity is evaluated according to the 
20 formula 

swingCapacity = 

server. maxFlowRate - S i e sactiveciients (client.get(i).session.minimumFlowRate) 
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The bandwidth requirement for client id in Step 920 is obtained as follows: 
requiredbandwidth = client.lookup(/d)'ContentSelection.averagePlayRate 

The predicate evaluated in Step 940 is given by the expression: 

(required bandwidth < = swingCapacity - server. cac flowSafetyMargin) 

[0072] In step 950, client activation entails allocation of a session and a channel, 
and insertion in the set of active clients eligible for bandwidth allocation by the 
optimal flow modulator. 

[0073] In step 960 the swing capacity is diminished by the amount reserved for the 
activated client: 

swingCapacity = swingCapacity - required bandwidth; 

Responding to Variations in Network Capacity (^Maximal Flow) 
[0074] In the CAC procedure for maximal flow, a safety margin was introduced, 
namely server, cac JlowSafety Margin, to provide the means for ensuring that the 
server's swing capacity will never fall below a minimal threshold value. 

[0075] According to this procedure, the foUowmg inequality always holds true: 
(15) swingCapacity > = server. cac flowSafetyMargin 

[0076] In the previous discussion, a server's swing capacity provided the basis for 
determining whether or not a prospective client should be allocated bandwidth. 
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[0077] By holding server xac JlowSafetyMargin in reserve, the CAC algorithm 
forces delivery of content at faster than real-time rates among accepted clients, 
even under the heaviest load. The net effect is to apply upward pressure on client 
side buffer levels, thus promoting continuous accumulation of content and a jitter- 
5 free viewing experience once a session is under way. 

[0078] In another embodiment, server swing capacity can also be interpreted as 
specifying the maximum amount by which the server, mcaFlowRate constraint can 
be dropped without affecting service, should such an adjustment prove necessary 
due, for instance, to an influx of exogenous network traffic that diminishes the 
10 amount available for multi-media services. Parameter 

server, cac JlowSafetyMargin can thus be set so as to guarantee a minimum 
capacity to tighten the constraint on maximum server flow in response to 
unexpected load changes that affect the server's ability to service its existing 
clients as well as new ones. 

15 Anticipating Scheduled Variations in Network Capacity (Maximal Flow) 

Overview (Figure 10) 

[0079] Figure 10 depicts how the constraint on maximum flow might be allowed 
to vary according to the time of day, day of the week, and so forth, in expectation 
of time-varying traffic flow levels extrapolated from past experience, traffic flow 

20 models, etc. Maximum flow rate 1000 can be seen to vary based upon the time of 
day. In practice, defining the right-hand-side of inequality constraint 1 as a time- 
dependent expression can impose such time-varying capacities. According to the 
previous description, the optimizer, which executes on a periodic basis, will 
automatically seek new flow levels for every active session as the constraint varies. 

25 There is, however, no guarantee that an acceptable operating point will be found 
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for all sessions (i.e. one that respects the minimai and maximum constraints on 
session channel flow). One such example is the case where the server is loaded to 
the limit and total capacity is curtailed in excess of the aforementioned safety 
margin. Should such a situation arise the only recourse may well be the 
5 termination of a number of established sessions (i.e. load shedding), 

[0080] The goal is to eliminate service disruptions of this sort by allowing the 
CAC procedure to look ahead into the future, and accept new clients only if these 
can be accommodated without any compromise in service in the midst of 
previously anticipated changes in available network capacity. The following CAC 
10 procedure generalizes the previous one: before accepting a client, the test on swing 
capacity is repeated over a sequence of time segments that cover the proposed 
viewing period. 
Definitions - 

Let: 

15 (16) t_end(i) = client. lookup(i).session.playTimeToGo + t_now 

Let server. maxFlowRate(t) be server flow capacity as a function of time, as 
exemplified in Figure 10. 

[0081] Let SeqT(t_now) = advancing sequence of future times, lead by t_now, 
when server. maxFlowRate(t) undergoes a step change. For instance, at 9:15 in 
20 Figure 10 this sequence reads as follows: 9:15, 9:30, 11:30, 13:30, 6:30, 7:30. 
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[0082] The server swing capacity at a future time t is computed according to the 
capacity and worst-case client flows at time t. 

(17) swingCapacity(t) = server. maxFlowRate(t) - 

2 t end(i) > t (client.lookup(i),session.minFIowRate) 

5 [0083] It is noteworthy that the worst-case client flows at time t are expressed in 
terms of the present minimum flow rates, which cannot increase over time, but 
might hold steady. Finally, a predicate is defined that tests whether a prospective 
customer will cause swing capacity to be exceeded at some time t, as follows: 

(18) boolean client_fits(i ,t) { 

10 if(client.lookup(i).contentSelection.averagePlayRate < 

swingCapacity(t) - server. cac_flowSafety Margin) 
return true; 
else return false; 

} 

15 Procedure CFigure 11) 

[0084] This procedure is an adaptation of the first, which has been extended to 
consider swing capacity at times in the future when capacity undergoes scheduled 
changes. Before accepting a client, its minimal bandwidth requirement (which by 
construction of the flow modulator will never increase over time) is checked 

20 against projected swing capacity at points in time when total available capacity 
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undergoes scheduled step changes, provided these times fall within the proposed 
content viewing period. A candidate is activated only if all tests succeed. 



[0085] Step 1 100 builds a sequence of time values (SeqT) at which step capacity 
changes are scheduled to occur. The first element of this sequence is t_now, 
5 representing the present. 

[0086] Beyond step 1100 the queue of waiting clients is scanned in FIFO order, 
yielding a candidate designated by id at each iteration, 

[0087] The bandwidth requirement for client id in Step 1 120 is obtained as 
follows: 

10 required_bandwidth = client. lookup(fc/)-contentSelection.averagePlayRate 

[0088] The worst-case end time for content flow to id is obtained according to the 
content selected, as follows: 



tend = tnow + client. lookup(rrf)-selected,playTime 



15 [0089] Steps 1130 through 1150 are executed within an iteration for each time 
point t in SeqT falling between t now and t end. This iteration is ended in step 
1130 if t exceeds the time window of interest, or in step 1150 if the supply of 
scheduled capacity changes is exhausted. 
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[0090] For each time value, step 1140 compares required bandwidth to projected 
swing capacity. 

Projected swing capacity at time t is: 

swingCapacity(t) = server. maxFlowRate(t) - 
5 2 t^„^j^ij > ^ (client. lookup(i). session. minimumPlowRate) 

[0091] Note that only active clients whose t_end times occur after t are considered 
in the sum of minimum flow rates. 

[0092] The predicate expression used in step 1140 at time t is thus: 

(required_band width < = swingCapacity(t) - server. cac flowSafety Margin) 

10 Step 1160 performs the same actions as step 660 in the previous CAC 

flowchart 

[0093] The first CAC process is a special case of the present one, in which the set 
of step change times to server. maxFlowRate is empty (i.e. server. maxFlowRate is 
constant), and Seqx(t now) = = t now. 

15 [0094] In preparing Seqx(t_now), one need only consider future times that will 

pass before the longest possible content is played out if started at t_now. In order 
to sidestep problems associated with rollover (at midnight, year 2000, etc.), time is 
best expressed as a monotonically increasing value (e.g. seconds since Jan 1 
1990). 
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CAC for Maximal Charges 

Overview (Figure 13) 
[0095] Previously, a method for flow modulation was presented that maximizes 
charges to clients with active sessions. The CAC embodiment presented 
5 previously was not sufficient as it does not consider the cost of service as a basis 
for connection acceptance. As a result, it may turn away higher paying customers 
while granting service to lower paying ones, thereby defeating the purpose for this 
particular embodiment. Therefore, another embodiment is defined which offers 
the following features: 
10 1. Awaiting clients are serviced in order of their respective service 

categories, higher paying clients first. 

2. Once accepted, a client is guaranteed to receive acceptable service 
irrespective of its service category. 

3 . Under heavy load conditions higher paying customers are more likely 
15 to be accepted than lower paying ones. 

4. Lower paying customers will no be starved for service when higher 
paying ones enjoy a surplus. 

5. Available bandwidth is not thrown away needlessly while clients are 
being denied service. 

20 [0096] The first objective is easily met by dividing the client queue into as many 
bands as there are service categories, resulting in a banded queue. Bands are 
ordered within the queue according to their service categories, with the costliest 
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category in front. As prospective clients arrive and make their selection they are 
placed in their respective queue band according to their service category (which 
may be set contractually, according to content selection, etc.). 

[0097] Our second objective is met by employing a procedure patterned after 
5 those presented previously & offering the same guarantee. Toward our third and 
fourth objectives we propose dividing total available bandwidth in as many strata 
as there are service categories. As depicted in Figure 12, two service categories 
are shown. Premium and Basic, each entailing an associated cost of service. A 
prospective client is accepted only if there is sufficient swing capacity available 

10 within its given service category. The swing capacity for a given category is given 
by the smaller of 1) the difference between its maximum floor flow rate 
(corresponding to the top of the stratum for the service category) and the sum of 
the minimum rates of all active sessions in its category or below, and 2) available 
swing capacity overall. Finally, our fifth objective is met by allowing the flow 

15 optimizer to function freely subject to its operational constraints. The imposed 

ceilings on call acceptance by category relate to minimum flow rates, which merely 
impose a floor on actual flow rates. For example, basic clients might well 
consume all available bandwidth 300 in the absence of any premium customers, 
yet could be throttled back toward their floor flow rates (which together cannot 

20 exceed 200 in this example) at any time should any premium customer suddenly 
demand service. In contrast, premium customers could consume the entire 300 
bandwidth. As lower paying customers appear these would be admitted to the 
degree that their quota on minimum flow is not exceeded (i.e. 200) and the 
availability of swing capacity on the system. 
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Procedure (Figure 13) 
[0098] The present procedure requires a number of ancillary definitions, wiiich 
follow: 

Let the service categories be denoted by k== 1...N, where k also denotes 
5 the cost of service. 

Let server. maxMinFlowRate[k-l] be the top of the stratum for service 
category k. Note that server. maxMinFlowRate [N-1] = server. maxFlowRate. 

Let S^be the set of active client indices with a service category equal to or 
less than k. Note that SI is contained in S2, S2 is contained in S3, and so forth, 

10 and that S^ — ^activeCUems, 

Let swingCapacity(k) denote available swing capacity for service category 
k. By construction: 

(19) swingCapacity(k) = minimum of: 

(server. maxMinFlowRate [k-1] - 2 iesk(client.lookup(i). session. minFlowRate)), 
15 (server. maxFlowRate - S j e sactiveciients (client.lookup(i), session. minFlowRate))) 

[0099] Referring to Figure 13, this method is used for CAC when multiple rate 
tariffs are in effect, and there is a desire to maximize economic returns to the 
service provider while offering acceptable service to all. 

[00100] All waiting clients are scanned in FIFO sequence. The actions taken in 
20 Steps 1320 and 1360 are identical to those described in connection with earlier 
CAC flowcharts. 
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[00101] Step 1340 evaluates a predicate expression that tests whether the 
required bandwidth can be accommodated without exceeding the lesser of 1) swing 
capacity available to the client's category of service, and 2) total available swing 
across all categories of service. The latter factor could be determinative if all 
5 available bandwidth were allocated to high paying customers, leaving lower paying 
ones such as the proposed client unable to draw from their unfilled quota. 
Let us suppose that candidate client id belongs to rate category k. 
We define the swing capacity available in rate category k as: 
swingCapacity(A:) = least of: 
10 (server. maxMinFlowRate[k-l] - S ^^^^k (client.lookup(i).session.minimumFlowRate)) 
and 

(server. maxFlowRate - 2 j e sactKecuents (client.lookup(i).session.mimmumFlowRate)) 

The predicate expression invoked by step 1340 can now be written as 
follows: 

15 (required bandwidth < = swingCapacity(A:) - server.cac_flowSafetyMargin) 

[00102] This algorithm processes queued clients in band sequence, and within 
every band in FIFO order. If the predicate evaluates to true, the client is 
activated. Otherwise two possible cases are considered: 1) under the FirstFit 
embodiment, the procedure continues scanning clients to the end of the banded 
20 queue, activating clients whose requirements can be met; 2) under the FIFO 

embodiment, the procedure ends with the first candidate client whose requirements 
cannot be met. Many other variations on these two embodiments might also be 
considered. 



-42- 



PATENT 

Atty Dkt. No. 032638-004 

Anticipating Scheduled Variations in Network Capacity (Maximal Charge) 
Overview 

[00103] The procedure applicable to optimization of delivery charges is obtained 
by blending elements of the CAC method depicted in Figure 13 into the method 
5 depicted in Figure 1 1 , which applies without change. To understand how this 

might work it may be useful to visualize a version of Figure 10 stratified along its 
length in the manner of Figure 8. As the maximum flow level undergoes a step 
change, so too do the widths of its constituent strata in equal proportion. 

Procedure 

10 [00104] As previously mentioned, the CAC method (Figure 11) applies to this 

circumstance also, provided we alter the definition of two routines, (17) and (18), 
upon which that procedure relies, yielding (20 ) and (21 ), and adopt the banded 
queue organization outiined in the previous section. 

[00105] The server swing capacity at a future time t is computed according to the 
15 capacity and worst-case client flows at time t. 

(20) swingCapacity(k, t) = minimum of ( 

( server. maxFlowRate(t) * (server.maxMinFlowRate[k-l] /server, maxMinFlowRate[N-l]) 
2 i e sk & (t_cud{i) > t) (client.lookup(i).session.minFlowRate) ), 

(server. maxFlowRate - S j e sactivcciients & (t_end(i) > o (client, laokup(i).session.minFlowRate))) 
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Finally, we define a predicate that tests whether a prospective customer will cause 
swing capacity to be exceeded at some time t, as follows: 
(21) boolean client_fits(i ,t) { 

k = client. lookup(i).costOfService; 
5 if(client.lookup(i).contentSelection.averagePlayRate < — 

swingCapacity(k,t) - server. cac flowSafety Margin) 
return true; 
else return false; 

} 

10 System Description 

[00106] Referring to Figure 14, a block diagram illustrating a preferred 
embodiment for a system implementing the methods presented herein is shown. 

[00107] Block 1485 depicts plurality of network-based client computers that 
receive data from a server over the course of a session. Every client sessions has 

15 an associated session block 1435 within the server by means which a flow rate of 
content from client to server is effected and regulated to a given flow rate set- 
point. The flow optimizer 1430 manages bandwidth utilization across all sessions 
that have been admitted by the system call admission control (CAC) and the 
bandwidth call admission control blocks, labeled 1400 and 1420 respectively. 

20 Specifically, the flow optimizer 1430 modulates the flow rate set-point of every 
active session so as to optimize aggregate flow or, more generally, cost. 

Call Admission Control 

[00108] Whenever a client contacts a server requesting service, the server must 
determine whether or not to admit the client. This admission function is 
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performed in two separate phases. The system call admission control block 1400 
considers whether or not sufficient internal resources exist to support the request. 
Toward this end, the system CAC 1400 estimates the needs of the prospective 
client with respect to a set of limited system resources such as I/O bandwidth, 
5 cache memory, open files, threads, etc. A request is denied if any required 

resource cannot be obtained. In the contrary case, the request is passed on to the 
Bandwidth CAC, which tests if the client fits and admits or rejects the client 
accordingly. The swing capacity is computed by the flow optimizer 1430 on a 
periodic basis according to equations (14) and (17) as appropriate. The managed 
10 bandwidth must reflect the true capacity of the attached network and the adapters 
leading thereto. This parameter should not be set arbitrarily high to prevent 
rejection of client requests. Doing so will cause the system to admit calls that 
cannot be properly handled, thereby diminishing the quality of the viewing 
experience. 

15 [00109] Having admitted a client, block 1430 creates a client session block 1435, 
which then begins to converse with its client-resident counterpart, 1480) during 
their launch phase. Thereafter, the flow optimizer 1430 assumes control, and 
modulates flow over the session until either all content is delivered, or a failure to 
deliver is detected, or one of a number of VCR-like stream control events 

20 intervene (e.g. pause, rewind, fast-forward). 

Server and Client Session Control Blocks 

[00110] Data Transport Channel 1450 is responsible for transporting data packets 
originating from the flow regulator 1440 within the server to the former's peer 
entity 1460 within the client. The mode of communication between the peer 
25 entities may be connection-oriented (e.g. TCP, which delivers a byte stream in 
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order, without duplication or loss) or datagram-oriented (e.g. UDP). Best-efforts 
datagram service is typically enhanced with acknowledgements to facilitate rapid 
recovery from occasional packet loss, out-of-sequence delivery, and duplication. 

[00111] Peered session control channels 1445 and 1465 permit configuration and 
5 status data, together with miscellaneous commands, to be sent from client to server 
and vice- versa. A reliable connection-oriented transport service is typically 
employed for this purpose (e.g. TCP). Data and commands alike are multiplexed 
over this channel in the service of other entities within the clients or server. Thus, 
a datagram-oriented data transport channel 1460 within a client 1485 might employ 
10 the session control channel to ferry selective acknowledgements to its peer in the 
server. Similarly, the flow meter 1465 within the client 1485 forwards the 
measured flow rate to the associated flow regulator 1440 within the server. 

[00112] The flow regulator 1440 obtains content data from a cache or disk, at the 
current offset into the content file, which it forwards as packets to the data transfer 

15 channel 1450. The size and/or pacing of the packets are determined by the flow 
regulator 1440 in order to achieve the flow rate set-point imposed by the flow 
optimizer 1430. The flow regulator 1440 is also responsible for determining the 
channel flow capacity to the client, which is the least of a configured value 
obtained from the client and a measured value. Toward this end, during the 

20 launch phase, the flow regulator 1440 might send content data packets to the client 
flow meter 1475 in a series of packet trains at progressively higher peak flow rates 
ending with the configured maximum flow rate, if any. The highest measured 
flow rate reported by the client flow meter 1475 is accepted as the flow rate 
capacity, which is posted for use by the flow optimizer 1430. Subsequently, the 

25 flow regulator 1440 will compare the flow rate set-point with the flow rates 
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reported by the flow meter 1465, and down grade capacity as needed should the 
measured flow rate fall consistently fall below the requested flow rate. Whenever 
such a downgrading occurs, the flow regulator 1440 will test for subsequent 
relaxation of a transient constriction by means of the aforementioned series of 
5 packet trains in which the peak packet flow rate exceeds the delivered flow rate. 

[00113] The buffer manager 1470 accepts data from the flow meter 1465, which 
data is retained until it is consumed or passed over the content consumer 1480. 
The buffer will typically be implemented as a ring buffer in memory or on disk. 
The write cursor will lag the read cursor by a no less than a specifiable time 
10 interval so as to permit rewinds of acceptable scope without requiring selective 
data re-retrieval from the server. 

Flow Optimizer 1430 

[00114] The flow optimizer 1430 assumes control over a session once it has been 
launched, and its channel capacity has been determined. Subsequently, it 
15 modulates the flow rate set-point of every session such as to optimize aggregate 
flow or charges across all active sessions, subject to a variety of min/max 
constraints on sessions flows, and a maximum constraint on aggregate session 
flow, as previously discussed. 

[00115] The flow optimizer 1430 continues to modulate session flow until all 
20 content has been delivered, or one of a number of session anomalies intervene, as 
follows: 

[00116] A downgraded session flow capacity drops below the minimimi session 
flow rate. The session is dropped by the optimizer 1430 as a solution involving 
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this channel does not exist. The user is forced to apply for re-admission, with the 
option of accepting slower than real-time delivery at the present encoding rate, or 
accepting a degraded viewing experience at a reduced encoding rate better adapted 
to the presently available bandwidth. 

5 [00117] A pause VCR command is received from the client. Flow to the client 
can continue until the client-side buffer is topped off, after which time flow drops 
to zero. The session is permanently dropped should the pause persists too long. 
Until that time, the CAC safety margin is temporarily increased by the jit (Just-In- 
Time) flow rate of the paused session. In this way the session can be resumed 
10 without the need for re-admission and the jit bandwidth is made available to 
currently sessions so long as the pause persists. 

[00118] A VCR Jump-Forward command is received from the client. This action 
is problematic as it causes the just-in-time flow rate (calculated at the new forward 
offset) to increase, in violation of the assumptions of the CAC algorithm. It must 
15 be noted that this violation will occur even if the content that is sought has already 
been delivered to the client-side buffer. One workable policy is to force the client 
to apply for re-admission at the forward offset and with a suitably modified buffer 
level. 

[00119] A VCR Jump-Backward (Rewind) command is received. This action may 
20 entail the need for re-transmission of content, as previously discussed- The just-in- 
time flow rate will decrease as per the new position and adjusted buffer contents. 
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Tunable Minimum Constraint 
[00120] A parameterized family of minimum flow constraints can be defined as 
follows: 

(22) 

5 wherein: fj^(t) = Target content flow rate for session k; 

JIT 

fk (0 = Just-in-time flow rate for session k; 

(RHS of Equation (5)) 
P= Burst tuning factor (positive or zero); and 
fj^^"(t) = Minimum (reserved) flow rate for session k. 

10 [00121] This family converges onfj^(t) > = f^^^(i) when P approaches 0. A p 

value of . 1, for example, ensures a minimum flow rate that exceeds the JIT flow 
rate by 10% . Thus, non-zero values of p force early delivery of content to a 
player's media buffer, with beneficial effects on the viewing experience. 

Alternative Call Admission Control 

15 [00122] The traditional CAC algorithm compares the flow rate requirement of a 
prospective client with the unused bandwidth (obtained by subtracting the 
aggregate flow target from the server flow capacity) and grants service if unused 
bandwidth is not exceeded. This procedure may break down as the optimizer 
causes all available bandwidth to be used if it can, thereby reducing unused 

20 bandwidth to zero in the best case, even when a new client could be 
accommodated with a healthy margin to spare, 

[00123] Nevertheless, a simple variation on this idea can be used. Available 
bandwidths can be defined as the difference between server flow capacity and the 
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sum of minimum flow rates for each session computed according to (22) as 



follows: 



(23) f 



available 




wherein: f. 



available 



= Available bandwidth 



5 



■max 



= Server aggregate flow capacity; and 

~ Minimum (reserved) flow rate for session n. 



Svr 



min 



[00124] Service is granted if the computed minimum flow rate of the prospective 
client is less than available bandwidth even when unused bandwidth is zero. 

Toward a Tunable OPS 
10 [00125] In the preceding discussion it is assumed that all clients share the same 

value of p. One might also consider a scheme whereby a client receives a p value 
according to the class/cost of service that client has signed up for: the greater the 
cost (and expected quality of service, or QOS) the greater the value of p. 

[00126] Instead of maximizing charges by the methods described above, a 
15 variation on the algorithm to maximize flow is considered whereby the reserve 

flow computation for every session takes into account the individual p value of the 
associated client. In this fashion a single algorithm can serve either end. The 
optimizer first ensures that every session receives its required minimum bandwidth 
(which would now typically depend on P and elapsed session time) before 
20 allocating any excess bandwidth more or less evenly to all by interpolation. 
(According to Figure 15.) 

[00127] The scheme is simpler computationally than the iterative interpolation 
method shown in Figure 16; it is also arguably more fair and stable with respect 
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tot he allocation of available bandwidth, 

Deadline-Driven Content Distribution 
[00128] In delivering viewable or audible content to a player, the optimization 
algorithm imposes a minimum flow rate that ensures that all content is delivered 
5 by the implied deadline, which is the last moment of a play session. 

Notwithstanding, the optimizer attempts to deliver content earlier according to 
bandwidth availability widiin the server taken as a whole, A similar, though far 
simpler scenario arises relative to the distribution of content from an optimized 
server to a target device, whenever the delivery must be accomplished by a 
10 designated time, or equivalently, within a given elapsed time, and when 

overlapped non-blocking consumption of the content at a fixed rate is not required. 

[00129] One example concerns the application where a session bundle comprises a 
session associated with the featured program together with sessions for every 
advertisement scheduled to interrupt the feature program at a designated time. 
15 Each session is endowed with a separate media buffer, which, in the case of ads, 
would typically be large enough to accommodate the ad in full, thereby permitting 
a seamless transition to the ad at the appointed time. 

[00130] In adapting the optimizer to the needs of content distribution we must 
revisit the formulation of the flow constraints, as follows: 
20 1, Media buffers are not of a concern, let alone buffer overflow, and 

it can be assumed that all content received is saved away in a file on disk, or in 
memory awaiting further use. 

2. For these same reasons, the value of p may be zero, at which the 
minimum flow rate equals the just-in-time rate obtained by dividing the content as 
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yet undelivered by the time till deadline: 
(24) f,'X)-L™''''/(Tk-g 



wherein: Lj^ = Content to go for session k, i.e., as yet undelivered 
by the server at time t, (client. lookup (k). session. pay loadToGo), 

Given the arbitrary format of the file to be distributed, T no longer 
signifies the "duration of play" at the average play rate (averagePlayRate); rather, 
T represents the elapsed time to the deadline measured at the moment the delivery 
session was launched, and t represents the elapsed time since session launch. 



Session Bundles 

[00131] A session bundle is a set of sessions that flow along a shared channel, and 
are thus subject to an aggregate flow constraint equal to the capacity of the shared 
channel. One important application of session bundles is connected with ad 
insertion. 



[00132] It is not enough to treat each of the constituent sessions as independent 
with respect to the flow optimizer, for this practice might well result in session 
flow targets that do not exceed channel capacity when considered singly, yet 
exceed this same shared capacity when summed together. 

[00133] A solution to this problem involves two distinct steps: 

1 . The sessions bundle is treated as a virtual session by the server 
optimizer, subject to the minimum flow constraint obtained by summation of the 
individual session minima, and a maximum constraint that is the least of (a) the 
sum of the least of constraints (3) and (4) for each session, and (b) the shared 
channel capacity client.lookup(k).channeLmaxFlowRate (4'^p). The flow 
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Optimizer then generates an aggregate flow target for all channels virtual sessions 
by interpolation, using: 

(25) Cost(t) - fi(t) + ,.+f,(t) 

[00134] The cost vector in this instance is the n-dimensional unit vector, where n 
5 is the number of active clients. 

(26) c = (l, 1,....,1) 



[00135] Now it is possible to have an achievable aggregate flow target for the 
session bundle k that we must apportion optimally among the constituent sessions. 
Fortunately for us, our interpolation procedure of Figure 15 can be applied again 
10 to the sessions in our bundle, but where the aggregate flow target generated above 
replaces the aggregate flow constraint f^"^^ 
Specifically: 

For every flow f^^ , within session bundle k, the optimal flow rate is 
obtained by interpolation between minimum and maximum session flows: 
15 (27) f,f = fr + a*(fkr-f,r) 

(28) a = [(f^" - 47 - . . .C)]/[(fr - fS^") - - (K^ - O] 
and the value of f J^""^^^ is obtained from a higher level optimization in which 
session bundle k is treated as a virtual session for which: 

\^^) \ • • • ^kn 

20 (30) 4 -mm(fki +..+iiai ' ) 

It must be noted that session bundles are typically dynamic in nature, outliving 
many if not all of their constituent sessions. Before a session is added to the 
bundle two CAC decisions must be reached: 

(1) establish bandwidth availability within the bundle; and 

25 (2) bandwidth availability within the server. 
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Relationship to Adaptive Rate Control 
[00136] The flow optimization methods should be viewed as constituting the 
lowest and perhaps only the first of many supervisory control layers to sit astride 
all streaming sessions, which comprise their own hierarchical stack of control 
5 ftmctions; rate adaptive control sitting above a flow rate regulator which relies on 
a transport entity. 

[00137] Channel capacity is known to vary widely over time, A capacity drop to 
below the minimum reserve flow rate is problematic as it causes the latter to rise in 
violation of its monotonicity assumption. In a server with available bandwidth to 

10 spare such a rise can be accommodated by the flow optimizer (by bumping the 

session's minimum flow reservation to the higher value) provided the flow deficit 
can be made up in the near term by draining pre-delivered content from the media 
buffer. Should either of these resources approach depletion, stream degradation to 
a lesser bit-rate or frame rate may be the only viable option short of a pause. 

15 Whether up or down, any rate change is a change to/e, which must be preceded 
by change to session* s reserve flow rate allocation by the optimizer. 

[00138] As can be seen, the optimizer and rate adapter must be integrated with 
care. One possible approach would be to modify a rate adapter such that it 
renegotiates its proposed/^ value with the flow optimizer prior to effecting the rate 
20 change it deems appropriate based on information provided by the flow regulator. 
Rate increases might well be subject to deferral under heavy load conditions, 
awaiting bandwidth availability. The opposite is true of rate flow decreases: these 
would be forestalled as long as possible by the optimizer on a system that is not 
fully loaded, as previously discussed. 
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Live Events 

[00139] Referring to Figure 17, the method of the present application can be 
extended to the optimization of "live", time-shifted "near-live" events, and 
cascaded delivery, wherein one server delivers content to another while the latter 
5 accepts clients for the same content. The extension assumes the following 
characteristics of the server and the live performance: 

1 . The performance is of a fixed duration T known in advance, 
encoded at an average rate/e, with a projected content pay load of fe^T; 

2. The origin server at the point of injection delays the stream by a 
10 small dwell time t^^^^l order of seconds (e.g. 10). Notwithstanding, the 

delayed content is available for early delivery to mirrored servers and players with 
the aim of providing these with a modicimi of isolation from network jitter 
affecting the timely delivery of the live video frames. 

3. Throughout the live event, captured content is stored in a file, 
15 thereby permitting late joiners to view the "live event" starting from any point 

between the present and the event start time; 

4. At the conclusion of the live event, the encoded content, now fully 
captured to a file, is available for viewing over the balance of the admission 
window (e.g., 60 minutes in Figure 17). 



20 [00140] The optimisation of live events and video on demand (VOD) differ 
principally in one respect, namely in the formulation of the server content 
underflow constraint. 

For VOD, this constraint is 

(31) 

TOGO 

25 Lj. (t) is initialised to the content size (fe'^T) at that start of play, and 

decremented as content is delivered to the client. At is the time interval between 
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successive periodic optimizations (e.g. 1 second). In practice this constraint rides 
well above other operative maximum flow constraints (e.g. buffer overflow, 
channel capacity) until the very last calculation of the session flow target by the 
optimiser. 

5 [00141] For a live stream, this constraint must additionally reflect the fact that 

content is streaming into the server (where it builds up), even as the server streams 
it out toward clients, and that the latter activity cannot possibly overtake the 
former, 

[00142] Referring to Figure 17, (which illustrates how optimised live streams 
10 behave) line LI depicts the build-up of freshly captured content to the server. 

Line L2, which is delayed (time- shifted) relative to LI by the dwell time T^"^^^^, 
represents the live performance as cast and viewable by clients. One such client is 
admitted at time A and joins the live session at the live moment B. The dashed 
curved line linking points B and C shows a plausible build-up of content in the 
15 client's media buffer in advance of play, as the viewer continues its advance along 
line L2. Past point C the top of the media buffer tracks the live capture stream 
and thenceforth advances along line LI. In this instance, the time shift between 
the live performance as cast (L2) and the live performance as captured (LI) 
imposes a maximum on the amount of content that could ever accumulate in a 
20 client media buffer, irrespective of its actual capacity. 

[00143] Another client, admitted at time t=10, is interested in viewing the live 
stream from the beginning without missing anything. As before, the dashed line 
joining 10 and D depicts a plausible build-up of content in the client's media buffer 
in advance of play, as the viewer continues its advance along line L3, which is 
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time-shifted by (lO + T^"^^^^) minutes relative to LL The greater time shift (now 
between LI and L3) permits more extensive pre-buffering of "near live" content. 



[00144] The present constraints do not impose suitable flow limits at and beyond 
points C and D when the client delivery streams finally links up with the live 
5 capture stream, in the live moment. Consequently the optimiser may propose flow 
targets that cannot be realized. 



[00145] Accordingly, the following modification for use in connection with live or 
cascaded streams is made: 

(32) f^it) < = [(L ™^^(t) - Live ™^^(t)] / At 
10 for a live event delivered at flow rate/e, we have 

(33) Live ™^^(t) = max(fe*(T-T ^^^^l.^^ 

[00146] Live ™'^*^(t) is the span between projected content sizefe *r (level line 
LO in Figure 17) and the content capmre level line LI, whereas L/^*^^(t) is the gap 
15 between LO (i.e., * 7) and the dashed curved line representing the content level 
delivered to the media buffer. The latter must always exceed the former. As the 
two approach one another this constraint takes effect, causing L/^*^*^(t) to always 
exceed Live^^*^^(t) as it decreases at rate fe. 



[00147] Viewers joining late and willing to see the live performance with some 
20 delay relative to the live case enjoy higher potential levels of isolation from 

network disturbances, and thus QOS, by virtue of their greater effective buffer 
capacity. By the same token, such viewers afford the optimizer greater latimde to 
optimize the flow of VOD and "live" content across load fluctuations, thereby 
enhancing server capacity. Viewers that wish to experience the live event in "real- 
ms?- 
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time" nevertheless benefit by a modestly enhanced QOS conferred by a dwell 
time's worth of content in their buffers. 

Summary 

[00148] A method and system for call/connection acceptance and flow modulation 
for network delivery of video/audio programming is thus provided. Although 
several embodiments have been illustrated and described, it will be apparent to 
those skilled in the art that various changes and modifications may be made 
without departing from the spirit of the invention or the scope of the claims. 
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